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Abstract 

Karush's proof of McMillan's theorem is recast as an argument involving 
polynomials with non-commuting indeterminates certain evaluations of which 
yield the Kraft sums of codes, proving a strengthened version of McMillan's 
theorem. 

Let len : A* — > N be the length function on the free monoid of all strings 
over a given non-empty finite set A. Let con : A** — > A* be the concatena- 
tion map which to every string of strings associates their concatenation. A 
uniquely decipherable code is a finite set CCA* such that con is injective 
on the submonoid C* of A**. This submonoid is then isomorphic to the sub- 
monoid C = con[C*} of A* freely generated by C. Denoting by r the number 
of elements of the alphabet A, the Kraft sum K(C) of any finite CCA* 
is defined as Y^xec r~ len( - x \ In [M] McMillan showed that if C is a uniquely 
decipherable code, then its Kraft sum is at most 1. The proof usually given is 
that of Karush [K]. This proof can be recast as an argument involving evalu- 
ations of polynomials with non-commuting indeterminates corresponding to 
the various (infinitely many) strings in A*, as follows. 

Let M. (A*) be the free associative R-algebra generated by the elements 
of A* considered as indeterminates, i.e. K. (A*) is the non-commutative ring 
of formal polynomials with real coefficients in the non-commuting indeter- 
minates x G A*. For w = (xi, ...,£„) in A** let P(w) denote the monomial 
xi ■ ... • x n in R (A*). 

Let C and D be finite uniquely decipherable codes over a non-empty finite 
alphabet A with r elements, and suppose that CCD. The Kraft sum K(C) 
of C is then the evaluation of the polynomial ^2 xeC x at x := r~ len ^ for 
x G A*. 



Fix a positive integer k. For any positive integer /, partition the set D l 
into two disjoint sets: 

Wn = {w G D l : con(w) G con[C k ]} 

W l2 = D l \ W a 

For every I the polynomial 

£*Y= E (i) 

is equal to the sum 

E PH+ E PH (2) 

Let m be the largest integer n with C fl con[D n ] ^ 0. Then the polynomial 

mk / \ ' mfe 

E E* =E E p(w) (3) 

z=fc Vxgd / i=kweD l 
is the sum of 

mk 

E E PH (4) 

l=k weWn 

and 

E E PH (5) 

Let J(C, -D) be the ideal of R (A*) generated by the polynomials x — P(w) 
for x G C, w G = con(w). Modulo this ideal, (4) is congruent to 

£*Y (6) 



The homomorphism R (A*) — > R evaluating each polynomial at x :— 
r -ien(x) j g nu jj on ideal £)) anc l therefore the evaluation of (3) equals 



2 



the sum of the evaluations of (5) and (6). The evaluation of (5) being non- 
negative, the evaluation of (6) is at most the evaluation of (3). For the Kraft 
sums K(C) and K(D) this means that 



mk 



K(C) 



k < £ K(D) 1 



(7) 



i=k 



Applying this to D — A 1 , as C C A 1 and obviously K(A r ) = 1, we obtain 

K(C) k <mk-k + l<mk 

and hence K(C) k < 1 and K(C) < 1 for all uniquely decipherable codes 
C. This holds for all k > 1. Recombining this with (7), letting C and D be 
arbitrary finite uniquely decipherable codes with CCD, and using now the 
knowledge that K(D) < 1, we obtain 



Recall that the definition of m is independent of the choice of k. Thus (8), 
being true for all k > 1, yields the inequality K(C) < K(D) : 

Extended McMillan Theorem // C and D are uniquely decipherable 
codes over the same alphabet, such that every string in C is a concatenation 
of strings in D, then the Kraft sum of C is less then or equal to the Kraft 
sum of D. 

This statement clearly includes the classical McMillan Theorem, corre- 
sponding to the case where D consists of all strings of length 1. 
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